A Neural Network Model for Apparent Deterministic Chaos in Spontaneously 

Bursting Hippocampal Slices 
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A neural network model that exhibits stochastic population bursting is studied by simulation. 
First return maps of inter-burst intervals exhibit recurrent unstable periodic orbit (UPO)-like trajec- 
tories similar to those found in experiments on hippocampal slices. Applications of various control 
methods and surrogate analysis for UPO-detection also yield results similar to those of experiments. 
Our results question the interpretation of the experimental data as evidence for deterministic chaos 
and suggest caution in the use of UPO-based methods for detecting determinism in time-series data. 
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With recent advances in the theory of dynamical sys- 
tems JjJ and nonlinear time-series analysis 0], many re- 
cent studies have looked for signatures of deterministic 
chaos in brain dynamics This is expected to help in 
understanding brain functions in terms of the collective 
dynamics of neurons and in achieving short-term predic- 
tion and control with potential medical applications. 

An experiment ji) on spontaneously bursting rat hip- 
pocampal slices bathed in a high-potassium medium has 
elicited much interest in this context. In this ex- 

periment, the occurrence of recurrent trajectories resem- 
bling unstable periodic orbits (UPOs) in the first return 
map of inter-burst intervals was interpreted as evidence 
for chaotic dynamics. Application of chaos control ||] 
was found to be more effective than periodic pacing in 
making the bursts regular. An anticontrol method de- 
signed to make the bursts more irregular was also tested 
with positive results. The apparent success of these con- 
trol methods was interpreted as further evidence for the 
occurrence of deterministic chaos. However, in subse- 
quent work ||, similar recurrent UPO-like trajectories 
were also observed in simulations of a stochastic single- 
neuron model and comparable success in chaos control 
and anticontrol was reported. Recent studies in 
which surrogate methods are used to assess the statisti- 
cal significance of UPOs claim to have re-established the 
original conclusion of deterministic chaos in hippocampal 
burst dynamics. 

We have developed and studied by simulations a simple 
but biologically plausible neural network model for hip- 
pocampal burst dynamics. While the variability of the 
inter-burst intervals in our model arises from stochastic 
transitions between two (quasi)attractors of the network 
dynamics, our simulations and surrogate analysis of the 
data yield results very similar to those reported |d|j^,^] for 
the brain slice experiment. Our work, thus, suggests that 
our model is appropriate for describing the experimental 



system and casts doubt on the interpretation of the ex- 
perimental data as evidence for deterministic chaos. 

The neural network model we consider is based on one 
developed [^0) for the process of "kindling" of epilepsy. 
The network consists of N excitatory neurons repre- 
sented by the binary variables {Si}, i — 1,2, , TV, with 

Si = 0(1) corresponding to quiescent (firing) states. The 
inhibitory neurons are collectively modeled by a back- 
ground inhibition assumed to be proportional to the in- 
stantaneous number of firing excitatory neurons. The 
"local field" hi(t) at the ith neuron at discrete time t is 
given by 

N 

h i (t)=J2[{JijS j (t)-wS j (t)} 

+X{K ij S j (t-T)-wS j (t-r)}], (1) 

where w is the relative strength of inhibition, A is the rela- 
tive strength of the delayed signal, and t is the time delay 
associated with the delayed signal. Starting from left, the 
four terms in Eq. ([!]) respectively represent fast recurrent 
excitation, fast global inhibition, slow recurrent excita- 
tion and slow global inhibition. These four ingredients 
are known |p"l|| to be essential for modeling hippocam- 
pal dynamics. Time t is measured in units of "passes" , 
each pass corresponding to random sequential updating 
(RSU) of N neurons according to the rule: Si(t+ 1) = 1 
if hi(t) > and Si(t + 1) = if h t (t) < 0. 

Initially a fixed number (q) of random low-activity 



patterns ("memories") {£f}, 



1,2, 



1,2, ,q, are stored in the synaptic matrices Jij and 

Kij through 

Ji& = Q(£ tftf ), K m = Q(£ tf* 1 ®' ( 2 ) 

with = J« = Kii = 0, and 6(m) - 1(0) 

for m > 0(m < 0). The net activity of each mem- 
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ory, Y^i£i> 1S set a t a va l ue p << N. Our simula- 
tions are carried out with the following parameter values: 
N = 200, q = 20, p = 10, w = 0.6, A = 2, r = 2 passes. 

The fast synapses Jy act to stabilize the system in 
a memory state, the global inhibition prevents simul- 
taneous activation of multiple memories and the slow 
synapses K%j tend to move the network from one mem- 
ory to the next one after r passes. For A > 1, the net- 
work evolution follows a limit cycle in which all the q 
memories are visited sequentially with the net activity 
S U p(t) — Yli=i Si(t) showing a low-amplitude oscillation 
around the average value p [see Fig.[l]a]. To simulate 
the effects of the high-potassium medium, the network is 
"chemically kindled" through a Hebbian learning mech- 
anism [jlo| switched on during 50 initial passes under re- 
duced inhibition (w is reduced from 0.6 to 0.24). During 
this period, if Si = 1 and Sj = 1 more often than 6 times 
over 10 consecutive passes, then the fast synaptic connec- 
tion Jij is permanently set to 1. Generation of these new 
excitatory synapses creates a new high-activity ("epilep- 
tic") attractor of the network dynamics. 
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FIG. 1. (a) Network dynamics before kindling; (b) Kin- 
dled network dynamics with spontaneous bursting; (c) 
Smoothened network activity with spikes. Thresholds are de- 
noted by dark circles and Ti, T2, . . . are the IBIs. 

The kindled network makes occasional, spontaneous, 
short-lived excursions to the high activity attractor [see 
Fig.[j]b], similar to the spontaneous population burst- 
ing observed in slice experiments. The net activ- 
ity is smoothened ("low-pass filtered") to S sm (t) = 
-p— Ylt'=t-t +1 S U p(t'), with t sm = 40. The bursts ap- 
pear as "spikes" in the smoothened data and the inter- 
burst intervals (IBIs) are measured from positive thresh- 
old crossings [see Fig.^c]. To prevent very rare occur- 
rences of persistent high activity, the network is reset 
to a randomly chosen low-activity memory state when- 



ever S sm (t) remains continuously above the threshold for 
more than 20 passes. 

The variability of the IBIs in our simulation arises 
entirely from the stochasticity of the sequence in which 
the neurons are updated. If a "deterministic" scheme in 
which the neurons are always updated in a (randomly 
chosen) fixed sequence is used, then the network remains 
in the low-activity state for most choices of the sequence, 
and exhibits periodic transitions to the high activity at- 
tractor for certain rare sequences. Similar behavior is 
found for parallel updating where all the neurons are up- 
dated simultaneously. We note that the RSU scheme is 
the most appropriate one for modeling systems that do 
not have any "clock-like" mechanism. 
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FIG. 2. (a) Autocorrelation of IBIs and sample IBI data 
in units of 10 2 passes (inset) for network 1 in the absence of 
control, (b)-(d) Probability distribution of IBIs from network 
(dotted line) and Poisson (dark triangle) simulations for no 
control (network 1, panel b), chaos control (network 6, panel 
c) and periodic pacing (network 6, panel d). 

We have studied 10 networks with different realizations 
of the memory states. As shown in the autocorrelation 
plot of Fig.||a, the IBIs are uncorrelated in time in all 
the networks. Further, the probability distribution of 
the IBIs follows a Poisson form, P{T n ) cx exp(— aT n ), 
for T n > 2t sm (this cutoff arises from our smoothening 
procedure) in all the networks [see Fig.||b]. These obser- 
vations strongly suggest that the spontaneous transition 
of the network from the low-activity state to the high- 
activity one is a stochastic process that has a small prob- 
ability p = 1 — cxp(— a) of occuring at each time step. 
As shown in Fig.^Jb, the results of a Monte Carlo simula- 
tion of a Poisson process with probability p of occurrence 
at each time step are identical to those of network sim- 
ulation. Results of our studies of the divergence of two 
trajectories starting from neighboring points in one- and 
two-dimensional delay embeddings of the IBI time-series 
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are consistent with the IBIs being independent random 
variables. 

Values of p for different networks exhibit a wide varia- 
tion in the range 8 x 10 -4 to 3 x 10~ 3 . Similar "sample- 
to-sample" variations and absence of correlations in the 



IBI time-series were reported in Ref. 12 for brain slices 
very similar to those of Ref. 0]. The variability in the 
raw IBI data of Ref. E^] is qualitatively similar to that 
in our simulation data [see inset of Fig.^Ja,] . 

Although the bursting in our model is stochastic, first 
return maps of the IBIs show purely accidental occur- 
rences P| of UPO-like trajectories [Q that approach a 
fixed point (T„ = T n _i = T*) along a line, T n — T* — 
si(T„_i — T*) (the stable manifold) and then diverge 
away along another line, T n - T* = s 2 (T n - 1 - T*) (the 
unstable manifold). In each of the 10 networks stud- 
ied, many recurrent UPO-like trajectories that satisfy all 
the criteria adopted in are found. Typical trajecto- 
ries used to identify an apparent UPO and the associated 
manifolds are shown in Fig.0. 




FIG. 3. Recurrent UPO-like trajectories in network 1. 
Three sequences (filled circles, squares and triangles, starting 
points denoted by 1) starting at different times around the 
same stable and unstable manifolds (dark lines) are shown. 
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FIG. 4. Results of chaos control(CC), periodic pacing(PP), 
and demand pacing (DP) runs of 300 IBIs each in network 1. 
No control is applied during the intermediate periods of 150 
IBIs. IBIs generated by external stimulation are denoted by 
stars. 

Following Ref. Q , we have studied the effects of various 
control methods. In the Proportional Perturbative Feed- 
back method of chaos control (CC) the system point 
is repeatedly placed on the stable manifold of an UPO 
detected during a trial period withour control. This is 
done by generating bursts at appropriate times through 
external stimulation, modeled in our simulation by a re- 



duction of the inhibition strength w from 0.6 to 0.24 for 
5 passes. Given a burst with IBI T n _i, the external stim- 
ulation is applied T n = si(T„_i — T*) + T* passes after 
the burst if no spontaneous burst occurs before its appli- 
cation. In periodic pacing (PP), the external stimulation 
is applied at fixed intervals of T* irrespective of the oc- 
currence of spontaneous bursts, and in demand pacing 
(DP), the external stimulation is applied T* passes after 
a burst only if no spontaneous burst occurs prior to its 
application. 

Typical results of the application of control, shown in 
Fig.[|, are qualitatively similar to those reported in Ref. 
Q. All three methods make the bursts more periodic 
by preventing the occurrence of large IBIs. While CC 
prevents the occurrence of natural IBIs above the stable 
manifold, PP and DP eliminate IBIs larger than T*. This 
is why CC is effective when T* is small and the slope S\ 
of the stable manifold is close to zero. In such cases, CC 
works better than PP because the occurrence of sponta- 
neous bursts between two successive stimulations in PP 
increases the number of short IBIs. Since this does not 
happen in DP, this method yields the best results. For 
example, in network 1 for which the selected UPO, shown 
in Fig.|, has T* = 225, Si = -0.162, s 2 = -4.8, the frac- 
tion of IBIs in the range T* ± t sm , measured in 5000 IBI 
runs, is 0.17, 0.68, 0.52 and 0.69 for no control, CC, PP 
and DP respectively (the statistical error bars for these 
fractions are less than 0.01). Thus, CC and DP work bet- 
ter than PP (see Fig.[|) in this case. The corresponding 
values for network 6, in which T* = 937, s\ = —0.476, 
s 2 = -1.68, are 0.03, 0.09, 0.21 and 0.4, indicating better 
performance of PP and DP over CC (see FigsJ|c, ||d). 




FIG. 5. The probability distributions p(T) (solid line) and 
psur(T) (dots) for a 128-IBI dataset. Inset: the function 
H(IU) used for estimating the statistical significance of UPOs. 
The arrow marks the maximum value of [p(T) — p SU r{T)]. 

Even when CC works well, 70-90% of the IBIs near T* 
are actually generated by the stimulation (see Fig.^J) : the 
probability of occurrence of spontaneous IBIs near T* is 
not significantly increased during control. A similar be- 
havior in the experiment is suggested by the experimental 
observation Q] that intermittent applications of the ex- 
ternal stimulation does not produce effective control. In- 
creasing the strength of stimulation improves control in 
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our simulations by preventing rare failures of the stimula- 
tion to generate the required burst. This is qualitatively 
similar to the results of double-pulse control in the exper- 
iment. The anticontrol method proposed in Ref. fails 
if applied over long durations (~ 1000 IBIs). In appli- 
cations of smaller duration (~ 100 IBIs), the variability 
of the IBIs increases in some cases due to statistical fluc- 
tuations. In the experiment, anticontrol was applied for 
short durations and failed in most cases. 

Our control results are similar to those reported in Ref. 
H for a stochastic single-neuron model. We have also 
simulated the effects of control on simple Poisson pro- 
cesses with p determined from the network data. The 
close agreement (see FigsJ|c, ||d) between the network 
simulation results and those of our Poisson simulations 
firmly establishes the stochasticity of the bursting in our 
model. 

Recently, the statistical significance of UPOs in brain 
slice data has been examined |?],|| using surrogate anal- 
ysis of windowed IBI datasets. These studies use a dy- 
namical transformation |?j that maps the neighborhood 
of an UPO in the return map to the UPO itself. First, 
the IBI time-series {T n } is transformed by 



T„ 



T, 



ra+1 



(3) 



where s n (k) = [(T n+2 - T n+1 )/(T n+1 -T n )] + k(T n+1 - 
T n ). The probability distribution p(T) of the trans- 
formed time-series {T n } is expected to show a sharp peak 
at an UPO, T = T*. Spurious peaks are eliminated 
by averaging over many random values of k. Using 
many realizations of Gaussian-scaled phase-shuffled sur- 
rogates |[4j of the original time-series, the probability 
that the observed peaks in p(T) could be modeled by the 
surrogates is estimated in the following way. From the 
collection of {p S ur(T)}, the ensemble average p SU r(T) is 
obtained. The deviation of p sur (T) for a particular sur- 
rogate from the mean p sur (T) is measured by 



w(T) 



(4) 



For each of the surrogates, W = max(w(T)) is measured 
and the fraction E(W') of surrogates with maximum de- 
viation W > W is found. The statistical significance 
of a candidate UPO at T* is estimated from the value of 
S(W) at W = p(T*) — p sur (T*). In our analysis, we used 
100 surrogates, k = 5R where R is a random number in 
[1,-1], and 500 values of R. We find that this method 
successfully rejects the UPO-like trajectories found in the 
network IBIs (properly rescalcd to match the analysis of 
Ref. @) only for long datasets (> 1024 IBIs), but not for 
shorter datasets (windows). Results for a typical 128-IBI 
window with a "statistically significant" UPO are shown 
in Figjfj. In this case, the probability of finding the peak 
of p(f) (near f = 0.5, with W = 3.437) in the surrogates 
is close to 4%, leading to the (false) identification of a 



statistically significant UPO at 95% confidence level. In 
such analysis of many non-overlapping windows of small 
width from 10 networks (544, 272 and 136 windows of 32, 
64 and 128 IBIs respectively), statistically significant (at 
the 95% confidence level) UPOs are found in 9 — 10% of 
the windows. The number of networks for which such sta- 
tistically significant UPOs are present in at least one of 
the windows is 8, 10 and 5 for window size 32, 64 and 128, 
respectively. These numbers are very similar to those re- 
ported in Ref. ||. Very similar results were found (e.g. 
75 out of 1024 non-overlapping 32-IBI windows showing 
statisically significant UPOs for network 1) in a surrogate 
analysis using a two-dimensional delay embedding H and 
both overlapping and non-overlapping windows. Ref. @] 
reports the detection of statistically significant UPOs of 
period higher than one in intracellular data which reflect 
a combination of collective and single- neuron dynamics. 
Our network with binary neurons is not appropriate for 
modeling such data. Nevertheless, a similar analysis of 
our IBI data is planned in future work. 

In conclusion, our neural network model with stochas- 
tic bursting dynamics successfully reproduces most of the 
findings of the brain slice experiment. This result casts 
doubt on the interpretation of the experimental data as 
evidence for deterministic chaos. Our work also shows 
that determinism and stochasticity need not be mutu- 
ally exclusive: the evolution of our network in the low- 
and high- activity states is mostly deterministic, while the 
transitions between these two states are stochastic. 

We thank Dr. G. R. Ullal for useful discussions. 
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